Piecewise-Planar StereoScan: Structure and Motion from Plane Primitives
نویسندگان
چکیده
This article describes a pipeline that receives as input a sequence of images acquired by a calibrated stereo rig and outputs the camera motion and a Piecewise-Planar Reconstruction (PPR) of the scene. It firstly detects the 3D planes viewed by each stereo pair from semi-dense depth estimation. This is followed by estimating the pose between consecutive views using a new closed-form minimal algorithm that relies in point correspondences only when plane correspondences are insufficient to fully constrain the motion. Finally, the camera motion and the PPR are jointly refined, alternating between discrete optimization for generating plane hypotheses and continuous bundle adjustment. The approach differs from previous works in PPR by determining the poses from plane-primitives, by jointly estimating motion and piecewise-planar structure, and by operating sequentially, being suitable for applications of SLAM and visual odometry. Experiments are carried in challenging wide-baseline datasets where conventional point-based SfM usually fails.
منابع مشابه
Planelet Transform: A New Geometrical Wavelet for Compression of Kinect-like Depth Images
With the advent of cheap indoor RGB-D sensors, proper representation of piecewise planar depth images is crucial toward an effective compression method. Although there exist geometrical wavelets for optimal representation of piecewise constant and piecewise linear images (i.e. wedgelets and platelets), an adaptation to piecewise linear fractional functions which correspond to depth variation ov...
متن کاملStructure and Motion from Two Uncalibrated Views Using Points on Planes
This paper is about the problem of structure and motion recovery from two views of a rigid scene. Especially, we deal with the case of scenes containing planes, i.e. there are sets of coplanar points. Coplanarity is a strong constraint for both structure recovery and motion estimation. Most existing works do only exploit one of the two aspects, or, if both, then in a sub-optimal manner. A typic...
متن کاملSegmentation, Matching and Estimation of Structure and Motion of Textured Piecewise Planar Surfaces
We present an algorithm which segments and matches the regions and then estimates non-iteratively 9D motion and structure of a moving piecewise planar textured surface from two perspective views. The algoriihm has two major steps. The first step is coarse. Here, the local planar nature of the surface is used t o obtain polynomial expressions for image plane displacements of features. Using regi...
متن کاملUrbanization of Arm M~vem~~s in Three-dimensional Space. Wrist Motion Is Piecewise Planar
Abstmet-4 is shown that human subjects are incapable of producing with the arm, in free space, planned or extemporaneously drawn trajectories in which the plane of wrist motion changes smoothly or continuously. The three-dimensional nature of these movements results from the fact that the plane of motion changes abruptly from one segment of the trajectory to the next, being conii~& to one plane...
متن کاملProjective Structure and Motion from Two Views of a Piecewise Planar Scene
In this paper, we address the problem of structure and motion recovery from two views of a scene containing planes, i.e. sets of coplanar points. Most of the existing works do only exploit this constraint in a sub-optimal manner. We propose to parameterize the structure of such scenes with planes and points on planes and derive the MLE (Maximum Likelihood Estimator) using a minimal parameteriza...
متن کامل